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[57] ABSTRACT 

An information delivery system including a head end broad- 
casting a data stream of media objects, the head end being 
coupled to a broadcast television interface and at least one 
information service provider and including an encoder for 
encoding information in the media object is disclosed. The 
system may deliver and implement a programming guide 
delineating programming information available on the infor- 
mation delivery system in one or more media objects in the 
data stream in an encoded fashion by the encoder. A user 
terminal is coupled to the head-end and receives the media 
objects. The user terminal has an output and includes a 
decoder for the media objects. Also provided in one aspect 
is a user interface, at least partially stored in the user- 
terminal, which selects a user-defined subset of media 
objects for provision to the output of the user terminal. 
Further, an information navigation system for an informa- 
tion delivery system is provided. The navigation system 
functions with the electronic program guide and includes a 
user interface having a plurality of icon representations of 
various functions of the system, and including a broadcast 
television interface. The navigation system also includes a 
smart service navigator which interacts with the user inter- 
face and the electronic program guide to provide an output 
to the user. 

22 Claims, 9 Drawing Sheets 
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1 2 

INTERACTIVE INFORMATION DELIVERY specifically to the delivery and selection of information 

SYSTEM delivered to a television user over a cable television system. 

2. Description of the Related Art 
Television has traditionally been a broadcast medium of 

5 entertainment. Service providers, such as television stations 

METHOD FOR CONTROLLING A SPRYTE RENDER- and networks, broadcast entertainment and information pro - 

ING PROCESSOR; U.S. Pat. No. 5,596,693, issued Jan. 21, gramming via a communications medium, such as a televi- 

1997, based on application Ser. No. 08/509,674, filed Jul. 31, sion network or cable system from the head-end of the 

1 995, which is a File Wrapper Continuation application of communications system to a client or individual user at the 

application Ser. No. 7/970,278 filed Nov. 2, 1992; Inventors: 10 receiving end of the system. While in the early days of 

David L. Needle, Robert J. Mical television, this meant transmission of the broadcast signals 

RESOLUTION ENHANCEMENT FOR VIDEO DIS- through the air, more recently, cable networks have become 

PLAY USING MULTI-LINE INTERPOLATION; U.S. Pat. commonplace. Transmission of the broadcast signals 

No. 5,481,275, issued Jan. 2, 1996, based on application Ser. through the cable network provides a much wider signal 

No. 7/970,287 filed Nov. 2, 1992; Inventors: Robert J. transmission bandwidth and opens the possibility for the 

Mical, David L. Needle, Teju J. Khubchandani, Stephen H, transmission of data in large quantities to the user. Band- 

Landrum width is defined as the information capacity of a particular 

DIGITAL SIGNAL PROCESSOR ARCHITECTURE; transmission system. This traditional model of one-way 

application Ser. No. 08/501,163, filed Jul. 11, 1995, which is m communication between the service provider and the user 

a File Wrapper Continuation application of application Ser. has recent] y begun to change with the proliferation of 

No. 8/001,463 filed Jan. 6, 1993, now abandoned; Inventors: interactive communication between the client and the ser- 

Donald M. Gray, III, David L. Needle V1CC provider. 

AUDIO/VIDEO COMPUTER ARCHITECTURE; appli- ^ television and cable network communication medium 

cation Ser. No. 08/591,952, filed Jul. 23, 1996, now 25 * a P arti cularly advantageous way to transmit a great 

abandoned, which is a File Wrapper Continuation applica- volume of information from the service providers to the end 

tion of application Ser. No. 08/442,634, filed May 17, 1995, users > lhe viewers, and to provide an interactive mechanism 

now abandoned, which is a File Wrapper Continuation for the viewer to utilize services such as video on demand, 

application of application Ser. No. 7/970,308 filed Nov. 2, home shopping, interactive games, and home banking using 

1992; Inventors: Robert J. Mical, David L. Needle 30 the television as the interface. However, using television as 

IMPROVED METHOD AND APPARATUS FOR PRO- me *>' correspondence between the service 

CESSING IMAGE DATA; U.S. Pat. No. 5,572,235, issued P rovuier md me ^d user requires extensive modification of 

Nov. 5, 1996, based on application Ser. No. 7/970,083 filed <™S communication hardware to provide one or more of 

Nov. 2, 1992; Inventors: Robert J. Mical, David L. Needle [he foUowmg: greater signal bandwidth, more powerful 

' _ J™ m ™„„, , „„™ „r head-end servers, and more powerful end-user receivers. 

SPRYTE RENDERING SYSTEM WITH IMPROVED 35 . ' ^ . , , t , . . 

CORNER CALCULATING ENGINE AND IMPROVED M shown m FIG * 2 » a tv P lc ^ cable , telcvisjon system 

POLYGON-PAINT ENGINE; application Ser. No. 7/970, comprises four main elements: the head-end 10, a central 

289 filed Nov. % 1992, now abandoned; Inventors: David L. originating point of all signals earned, where signals are 

Needle, Robert J. Mical, Stephen H. Landrum, Donald M. rec f lv u ed from se ™ cc P rovlders (^vision networks, spe- 

Gray III 40 0 channels, etc.) in process; a trunk system 12, the mam 

METHOD AND APPARATUS FOR UPDATING A signals a commudty; a distribution 

CLUT DURING HORIZONTAL BLANKING; application (mcludmg trunk bridging amphfiers 14) which is 

Ser. No. 08/300,867, filed Sep. 2, 1994, which is a File bn ^f b ™ t ^f^™ Ca ? e T . A 

c i- o kt t/^o nnx vidual neighborhoods for distribution to subscribers; and 

Wrapper Continuatron of apphcation Ser. No. 7/969 994 subscriber ^ u> includin individual ^ 18 to sub . 

5? d , N n " \ i m ^abandoned; Inventors: Robert J. telev £ ion ^ fod f * m (Afefl j ^ 2 

Mical, David L Needle, Teju J. Khubchandani ^ m ^ ^ Mon {cm ^ hcad . cnd 

DISPLAY LIST MANAGEMENT MECHANISM FOR kc|udc \ satellite systeniy tapc processing> Hve 

REAL-TIME CONTROL OF BY-THE-LINE MODIFI- programming cameras, signal-processing equipment, pilot 

ABLE VIDEO DISPLAY SYSTEM; U.S. Pat. No. 5,502, 5o ^ gener a tors , comb ining networks, and I equipment for 

462, issued Mar. 26, 1996, based on application Ser. No. bi-directional interactive services. The subscriber equipment 

8/146,505 filed Nov. 1, 1993; Inventors: Robert J. Mical, may comprise end-user terminals, converters, 

David L. Needle, Stephen H. Landrum, Teju J. Khubchan- de-scramblers, teletext decoding equipment, and the like, 

depending on the particular service in place and the sophis- 

EXPANSION BUS; application Ser. No. 08/302,380, filed 5S tication in bandwidth of the given system. The trunk system 

Sep. 8, 1994, now abandoned, which is a File Wrapper ma y be physically composed of open air broadcasts, fiber 

Continuation application of application Ser. No. 8/001,070 opt i c i meSj coaxial lines, or a combination of each, 

filed Jan. 6, 1993, now abandoned; Inventors: Richard B. Jn &6mQn to providing video md music programming, in 

Tompane, Dean M. Drako, David L. Needle m interactive system7 a significant quantity of information 

Each of these patent applications is assigned to the 60 must De transmitted to the viewer as part of the interactive 

assignee of the present invention and is specifically incor- service environment. For example, the interactive environ- 

porated by reference into the present application. ment may include several different interface screens utiliz- 

BACKGROUND OF THE INVENTION ^ a "^ti-media" format (combining several different 

types of data, video, and audio), and a pointer or other means 

1. Field of the Invention 65 (such as a control pad-controlled cursor) for interacting with 

The invention relates to the delivery, selection and com- each of the data, audio, and video elements on the interface 

munication of information in an interactive format, and screen. As yet, no standard transmission or interaction 
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format for the distribution system has been settled upon, and nication for such a system is minimal, thereby limiting user 

a number of standards are currently under development by response and choice. A local server for the particular small 

television, telephone, or other communications providers. area which Spectra vision services is all that is required. 

A number of commercial services currently exist which Spectravision also provides the viewer with the ability to 

provide broadcast programming along with data to a home 5 switch between dedicated Spectravision services and regular 

viewer. Perhaps the most basic of these is commonly full broadcast television services. 

referred to as "Teletext," and provides cyclical digital data In providing interactive services in larger cable network 

inserted in the vertical blanking interval of a video signal. applications, the main problem which arises is that of server 

(The vertical blanking interval is a standard interspersed and communications overhead. Allowing each subscriber to 

period in a video signal which is approximately the black 10 browse and navigate through all available services, (such as 

level of the signal, used to accommodate retrace periods of an electronic program guide for video-on-demand services,) 

display scanning.) The amount of data which may be sup- creates substantial processing overhead on the head-end 

ported and transmitted by the Teletext system is limited by server. This, in turn, requires that the speed and capacity of 

the bandwidth of the vertical blanking interval. As such, the the head-end server be increased for the system as a whole 

data capacity is limited and the net result is usually the 15 to be commercially effective, which increases the cost of the 

provision of this format of a few lines of text at the base of system. 

a television screen in the user's home. Teletext services can As shown in FIG. 2, an interactive delivery system 

provide a viewer with a wide variety of useful information requires a physical delivery system which provides back- 

which can be program oriented, or completely independent channel communication. An attempt to provide a fully 

of the program. The viewer uses a remote control key pad to 2 o interactive television interface on a larger scale will be made 

select television images, teletext pages, or a combination of by U.S. West, Inc., a telecommunications company, which 

both. Some forms of two-way teletext exist, but these will conduct a trial of an interactive system in Omaha, Nebr. 

systems usually include an entry keyboard and a return link, In the U.S. West example, the network configuration will 

via a telephone line, to a database. comprise a broad-band network to provide video and data 

A second commercial service to provide data over tele- 25 services. The broadband network is comprised of a head-end 
vision transmissions is known as the "Sega Channel." The broadcasting server 20 providing transmission to a plurality 
objective of the Sega Channel is to allow users of the Sega of video switches 24 and nodes 26. The video switch will 
video game system to download software games directly transmit packets of data continuously or in bursts through 
from a broadcast channel for use on the game system rather the broad-band network. The video switch 24 will deliver 
than requiring the individual user to go to a retail store to 30 signals to a node 26 that will serve from 200 to 2,000 homes, 
purchase game cartridges. The Sega Channel broadcasts From the video node, dual co-axial cables A,B will be used 
game program data on a standard cable channel via a cable for distributing video signals to a pedestal that will contain 
network, in a continuous data stream of software games video distribution equipment, video interaction equipment, 
which the user may desire to download. Each game is and an optical network unit. As shown in FIG. 3B, the video 
broadcast at a different time, and broadcast information 35 portion of the network is a dual co-axial cable design, with 
includes game identification information which is decoded a sub-split design "A" cable providing 650 mhz of band- 
by the game system in the user's home and which identifies width to support 77 analog channels, up to 136 digital 
the game to the system for downloading. The game system channels, and 25 mhz of shared upstream (or backchannel) 
shows the individual user a selection menu on the user's capacity. The spectrum "B" cable provides 500 mhz of 
television from which the user can select the particular game 40 bandwidth to support up to 664 digital channels and 107 mhz 
he or she wishes to download. When the game is transmitted of shared backchannel capacity. The split design allows for 
over the broadcast medium at the appointed broadcast time, channel frequency compatibility of the analog channels with 
the game will be downloaded into the game system and the existing cable-ready TV sets, while the "B" channel pro- 
user may then play the game in the game unit. The Sega vides backchannel capacity anticipated for the more inter- 
channel transmission scheme does not include any provision 45 active services expected to use digital channels. A spectrum 
for "backchannel" information from the user to the infor- of the transmission bandwidth of approximately 1 GHz is 
mation service provider. shown in FIG. 3A. This U.S. West embodiment illustrates 

Another commercial broadcast system which does pro- h° w & e aforementioned problems will result. The commu- 

vide some backchannel communication, but is limited to nications overhead on the head-end which will result from 

smaller broadcast environments, is commercially known as 50 backchannel communications and viewer demand, even in 

"Spectravision." Spectravision is generally set up in small the limited service area of the experiment, is quite signifi- 

environments such as hotels, resorts, or other limited areas, cant - 

and the viewer is provided with one or more screens of When a user is browsing or merely viewing the possible 
information for video on demand, and hotel services such as selections available from the head-end, communication with 
in-room checkout, room service, and billing queries. The 55 the head-end server is required; however, no revenue for the 
user, through an end-user box and accompanying remote service provider is created during the browsing events. Thus, 
control interface, can request in-room movies through the activities such as browsing increase the cost for all revenue- 
video on demand interface, request account information, or generating activity. It would therefore be desirable to reduce 
perform a check out, all through the Spectravision interface. the load on the head-end server which is required for any 
Information which must be transmitted to the user in this 60 such non-revenue generating activity, 
system includes the complete video on demand menu In the aforementioned prior art transmission schemes, the 
(several screens of data), customer services menus and bandwidth allocated from the head-end to the home user is 
summaries of account information on the customer's quite large in comparison to the backchannel band-width 
charges during the stay in the hotel, and menus which the allocated for viewer communication to the server. Because 
consumer may scroll through on demand and select to 65 the total amount of bandwidth through the backchannel 
perform such services. This usually represents a fair amount which will be required at the head-end at any given time will 
of textual information, however, the backchannel commu- fluctuate with the use pattern of the subscribers (the number 
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of subscribers making demands on the head end at a given As described in the Bowen, et al. paper, the system is 

time and the activities of those subscribers), such fluctuation useful, for example, in providing a directory assistance 

will place unpredictable communication latencies on the database which may be continually updated and provided to 

system. It is important to determine all communication the directory assistance operators of a given telephone 

latencies on the backchannel to determine operating param- 5 network 

eters for a commercially viable system and for service }n consideratioa of me blems> a communi . 

providers to configure their programming so that the user is ^ reduces the overall overhead at the 

not unduly burdened during the periods of maximum latency £ atloas * ystem ™f cn re< T ces tne overnead at me 

in the s stem head-end and still provides complete interactivity and a 

AJJ v t * . i j • ■ j j • u j large quantity of information to the user is therefore desir- 

Additiona! processing overhead is required during hand- 1Q * M J 

shaking. Handshaking comprises the interaction with all a e ' 

communications to the server involving a response mecha- cmm^ aw ad tut: TisjwDvrrrrnvr 

nism to the user which ensures reliable communications SUMMARY OF THE INVENTION 

between the server and the user. A simplified communica- It ^ therefore an object of the invention to provide an 

tions model that does not require, or at least minimize, server information delivery system for use with a communications 

intervention in handshaking is desirable. medium which reduces the overall overhead of the system 

Congestion within the communications pipeline resulting md yct pT0W {fe f^u interactivity for the end user. 

from large bursts of backchannel communication can impair A 4 . . , . e 

c * u n- • i A further object of the invention is to provide an rafor- 

the quakty of service to viewers by resulting in a large , , J t L . , ... ^ riL 

latency period. A large volume of backchannel communica- delivery system which operates independently of the 

lion or a "connection storm" can occur when large numbers 20 physical network to which it is applied and thus may be used 

of viewers simultaneously request service, as at the start or on a variet y of different networks. 

end of a popular event, or after a power outage when the Yet another object of the invention is to provide an 

users are attempting to re-establish service. This again can information delivery system which can be utilized on current 

result in unpredictable latency times. communications networks in use throughout the country. 

Each server has a finite bandwidth, and congestion will 25 A further object of the invention is to provide the afore- 

occur at the server as the number of requests it must handle said ^ ng conventional signal and compression 

increases. Indeed, in large scale implementations, a network sc hemes currently in place, 

of servers will be required to distribute requests and balance „ . . 

the load on the network infrastructure, also increasing the toh f ob J e u ct ° f the mention is to provide a standard 

expense of providing service to users. 30 user interface which is intuitive to use and based on current 

Any one or more of the aforementioned difficulties could viewin S which provides a viewer access to the 

result in the interactive viewing experience being less seam- scrvlces available on the information system, and which 

less than the viewer currendy experiences with analog ma y be u P dated 35 new ™ 6 different servicc providers 

television signals. For any system which utilizes digital broadcast on the system. 

communication technology to transmit data to a viewer to be 35 These and other objects of the invention are provided in 

commercially viable, the system must make the viewing an information delivery system having a number of inven- 

experience appear as seamless as the viewer's current view- tive aspects. A first aspect of the invention comprises an 

ing experience. Viewers have come to expect a minimum information delivery system. The system includes a head 

level of broadcast quality in television viewing, thereby end broadcasting a data stream of media objects, the head 

requiring any new system be comparable to current systems 40 end being coupled to a broadcast television interface and at 

in the manner in which programming and information is least one information service provider, and including an 

presented to the viewer. encoder for encoding information in the media object. A 

Thus, it is desirable to provide an interactive system programming guide delineating programming information 
which will overcome the aforesaid deficiencies in a broad- available on the information delivery system may be pro- 
cast communications medium. 45 vided m one or more media objects in the data stream in an 

One means of disseminating a large amount of data over encoded fashion b ? me encoder. Auser terminal is coupled 

a network and is the "Data Cycle" proposal and research set to the head-end and receives the media objects. The user 

forth by Bellcore (Bell Communications Research, Inc.). terminal has ™ 0Ut P ut ««* includes a decoder for decoding 

The data cycle is a proposal for a distributed, shared memory information in the media objects. Also provided is a user 

database implemented through use of a storage pump which 50 interface, at least partially stored in the user-terminal, which 

continuously broadcasts the entire contents of the database selects a user-defined subset of media objects for provision 

over a ring network to a series of access managers which t0 the 0Ut P ut of the ^ terminal. 

control, for example, SQL-type application access to the The system allows the reduction of head-end server 
data which is broadcast on the network. In the embodiments overhead and predictable system latencies, and one can 
described in a paper entitled "The Datacycle Architecture: A 55 customize the data stream for individual purposes, or pro- 
Database Broadcast System", authors Bowen, et al, a data vide additional data streams in hybrid systems using both 
rate of 52 megabytes per second is supported such that a 32 digital and analog signals. 

megabyte database stored on a single storage pump is A second aspect of the invention comprises an encoding 

entirely broadcast every 0.6 seconds. A user seeking to structure for an information delivery system. The structure 

extract data from the database initiates a query through an 60 makes use of a dictionary library containing terms and 

access manager via one of any suitable number of applica- common phrases of the information to be encoded. A listing 

tions. The access manager then extracts the data and pro- array is provided which includes a set of listing oflsets to the 

vides it to the application and ultimately the user. The terms and phrases in the dictionary library, and a plurality of 

database is continually broadcast over the broadcast channel listing vectors provide offsets into the listing array. A sorting 

at a repeating rate, and therefore may be updated via an 65 vector contains sorted offsets into the listing vector and can 

update manager coupled to the access managers and the be used to perform queries of the encoded material while the 

storage pump. material is encoded. 
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The encoding structure provides an improvement over 
conventional coding structures by optimizing the encoded 
data structure for decoding by the end user terminal in the 
information delivery system, and gives greater compression 
ratios than found in currently -employed techniques. 5 

In yet a third aspect of the invention, an information 
navigation system for an information delivery system is 
provided. The navigation system includes an electronic 
program guide, the electronic program guide comprising a 
listing of programming available on the information delivery 10 
system. The navigation system also includes a user interface 
having a plurality of object representations (such as icons) of 
various functions of the system, and including a broadcast 
television interface. The navigation system also includes a 
smart service navigator which interacts with the user inter- 15 
face and the electronic program guide to provide an output 
to the user. 

The information navigation system works in conjunction 
with the delivery system and the encoding structure to 
deliver to the user a seamless, realistic, real-time interactive 20 
viewing experience, while minimizing such problems as 
communications overhead, transmission congestion, unpre- 
dictable system latencies, and finite server bandwidths. In 
addition, the navigation system provides information to the 
transmission and service providers which allows the pro- 25 
viders to optimize use of the network and services. 

BRIEF DESCRIPTION OF THE DRAWINGS 

The invention will be described with respect to the 30 
particular embodiments thereof. Other objects, features, and 
advantages of the invention will become apparent with 
reference to the specification and drawings in which: 

FIG. 1 is a block diagram of a conventional cable tele- 
vision network. 35 

FIG. 2 is a block diagram of a communications medium 
suitable for use with the information delivery system of the 
present invention. 

FIG. 3A is a diagram of a bi-directional trunk system 
shown in FIG. 2. 40 

FIG. 3B is a diagram of the subdivision of the 
bi-directional trunk system shown in FIG. 3A. 

FIG. 3C is a diagram of the frequency spectrum of the 
sub-divided bi-directional trunk system shown in FIG. 3B. 45 

FIG. 4 is a representation of an exemplary interface screen 
which may be provided by an end-user terminal to a user. 

FIG. 5 is a table representing media object type, size and 
bit requirements. 

FIG. 6 is a table representing the type and number of 50 
media objects suitable for use in a user interface in accor- 
dance with the present invention. 

FIG. 7 is a block diagram showing the interaction between 
the MPEG2 transport layer and a network interface in a user 55 
terminal. 

FIG. 8 is a table representing the bandwidth and space 
requirements of the objects shown in FIG. 6. 

FIG. 9 is a depiction of the encoding scheme for the 
electronic program guide of the present invention. eo 

DETAILED DESCRIPTION OF THE 
INVENTION 

The interactive information delivery system of the present 
invention will be described with reference to FIGS. 2-9. 65 
Although the system of the present invention will be 
described with reference to a particular hardware 
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embodiment, and specifically the network embodiment pub- 
licly disclosed for the U.S. West trial for Omaha, Nebr., it 
should be understood that the invention is not limited to any 
particular hardware configuration. Indeed, a feature of the 
invention is that the system is designed to be utilized on any 
number of different communication hardware schemes 
which may be currently in existence or hereafter developed. 

Generally, the invention utilizes a broadcast streaming 
approach to information delivery through a conventional 
television distribution network. Through this approach, full 
motion video, still images, artwork, music, information and 
other data can be provided to the end-user and used as an 
information guide to all information sources available on the 
network to minimize the problems which attend implement- 
ing an interactive television system. A single broadcast data 
stream of such information is repeated at a pre-determined 
rate, with a "smart" end-user terminal decoding the data 
stream, thus providing a pre-determined and consistent 
latency period. The data stream may be broadcast on a single 
6 mhz broadcast channel, available on any number of 
commercial cable television networks (including the U.S. 
West embodiment set forth above). It should be noted that 
the particular transmission provider is not critical to the 
invention. 

A unique advantage of this system is that information 
provided through this format can comprise information 
which would be considered non-revenue generating, but 
overhead intensive on the head end. Thus, the overhead on 
the head-end is reduced without any loss of information to 
the user. In addition, one or more data streams may be 
utilized, with each stream serving a particular service pro- 
vider's special requirements. Thus, the service provider may 
customize both the individual objects which the provider 
contributes to a common stream transmitted by, for example, 
a cable network operator, or may generate an exclusive 
stream of its own to provide exclusive information to its own 
broadcast stream. 

The information is provided to the end-user terminal in 
the form of media objects. A second feature of the invention 
is the digital compression and de-compression of the data. 
Through the use of MPEG-2 data transport, the data, text, 
video, and other signals in the broadcast data stream can be 
sent through the normal broadcast channel and contain 
enough information to supply the "smart" terminal with 
program and service information to make the output at the 
user-end appear to be completely interactive, allowing the 
user to interact with the data without placing undue burdens 
on the head-end of the system. Hie stress and sophistication 
of interactivity on the end-user of the system can be depen- 
dent on the hardware in use at the user-end of the system. As 
hereinafter described, by using video modulation, a 6 mhz 
channel will support a bandwidth of 30 Mbps when modu- 
lated at 64 quadrature-amplitude modulation (QAM). This 
yields an effective bandwidth of 27 Mbps for the delivery of 
media objects, after accounting for transport level error 
correction coding. 

An additional feature of the invention is a user interface 
and service navigator which generally comprises two com- 
ponents. A first component will be resident at the user-end, 
in the end-user terminal, and includes the ability to com- 
pensate for transmission system latencies. A second com- 
ponent of the user interface will allow the particular service 
provider at the head-end to program a variety of situation- 
based responses for the user interface to enact when any 
communication latencies occur. The provision of these 
situation-based responses is possible because of the known 
values for the maximum latency of the repeating broadcast 
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data stream, which is the maximum latency for the system. The novel user interface and service navigational scheme 

An overview for the user interface provides a programming of the present invention will be described with reference to 

navigation format through which the service provider can FIG. 4. FIG, 4 shows components of the user interface, 

implement customized menus particular to the broadcast comprising an overview of an interactive interface screen 

data stream 5 wilh various different media objects placed thereon. As 

Yet another component of the user-interface allows for the ? °™ in * IG ,; 4, media objects represent icons for a 

recording and storage of user-preferences based on repeated ^ edia v ^ et > *J* ^ lde <* n elec " ^gram 

. . . * r r video on demand guide, and a navigation guide. Standard 

inquiries e sys em. broadcast television can also be provided in a window with 

Through use of the broadcast streaming feature, data a me dia object used to overlay the picture with current 

compression and the service navigator, the user is provided 10 information about the program. 

with a fully interactive experience while the stress on the The user interface is designed to provide viewers with 

head-end and communication overhead is limited. Hence, optimum choice, but not to overload the user with too many 

the number of video servers required at the head-end is choices which will drive the user to avoid using the interface 

reduced, while the latency of the system is made predictable. because he/she is overwhelmed. The interface is designed to 

Thus, the system of the present invention provides superior 15 leverage itself off what the viewing public currently 

navigation to television viewers as they cope with the great experiences — integrating new experiences around viewers' 

number of choices available to them while reducing the existing experiences. The user interface of the present inven- 

hardware overhead required for system navigation. tion uses the predictable response times of the broadcast data 

Additionally, while using digital media objects transmit- stream to offer interactivity to the services offered by the 

ted in a compressed format, the user is provided with a 20 information providers through a consistent look and feel, 

seamless viewing experience nearly equivalent to that pres- The user interface of the present invention is highly 

ently experienced with analog signals. A plurality of such visual. The interface items are depicted by representations of 

objects may be provided to the end user, thereby increasing themselves. For example, movies can be represented by 

the quantity of information that a user is exposed to, while poster art, and services can be represented by the service 

allowing the presentation of such information to be manipu- i ogo . As such, the viewer can instantly comprehend the 

lated in a common format and into a highly optimized hierarchy and array of items available, 

manner for both the user and service providers. This advan- interface incorporates graphics, music and transition 

tage is provided through the use of a "smart" user end effects which have a quality similar to or equal that of a 

terminal, the user interface, and a "smart" service navigator, ^ television picture. By animating the visual display, the 

as will be hereinafter described. The system of the present display is never idle when waiting for viewer input, 

invention therefore presents a commercially viable improve- Furthermore, the interface provides a navigation platform 

ment to existing interactive television approaches. that may be utilized across different service providers. A 

In the transmission system shown in FIG. 2, the head-end standard paradigm provides a singular visual understanding 
server 20 is utilized to encode and transmit a plurality of 35 of the categories and hierarchy of items which are available, 
media objects into the data stream into the trunk system. In one embedment, me paradigm comprises an organization 
Each media object conforms to a specific model representing wherein one moves vertically on the screen to choose 
composition of various media types, such as video, still between higher level categories, while one moves horizon- 
pictures, background artwork, music or text. Using each of tally to select within the category. As such, more than one 
the media objects, complicated structures can be built from ^ menu can be displayed at a given time, and the viewer is less 
easy to manipulate and simple to define components. Each likely to get caught in layer upon layer of menus, 
media object embodies a broad set of fuactionahty requiring Furthermore the interface is designed to be expandable, so 
minimal effort to construct useful visual, auditory, and mat as more services become available and more program- 
sensory output for the user interface. mmg ^ offered, they can be easily added to the interface by 

Each object can comprise data which is provided to the 45 adding different media objects to the data stream, 
"smart" terminal to define the information which is to be A further unique aspect of the interface is the provision of 
placed in the user interface and displayed to the user, a smart service navigator or "media valet." Through the use 
information for the user interface as to how the object should Q f intelligent filtering and weighting algorithms, the inter- 
be depicted by the user interface, any information regarding face can be personalized for each viewer household. The 
elements for controlling the object (such as buttons, visual 50 media valet acts to record viewer preferences based upon 
gauges, etc.), and code which controls the behavior of the any number of algorithms which can not only record 
object in the form of scripts or embedded code contained by preferences, but make suggestions to the user for programs 
the object. which the user may find similar or interesting, based upon 

Each media object may comprise, for example, an elec- the viewers recorded viewing habits. For example, the 

tronic program guide, a short video clip of a video on 55 service navigator may note that the viewer tends to view 

demand program, or other information which is designed to movies in a particular genre with a particular movie star, 

be a control mechanism for other objects. In such a delivery When a new listing of a movie which fits a similarity profile 

system, the communications load on the system relies sub- becomes available, the valet may suggest this option to the 

stantially in the transmission of data and images to the user. 

network, thereby minimizing backchannel communication, eo The service navigator may be programmed by the user for 

FIGS. 3A-3C show a block representation of the specific preferences, however a unique aspect of the inven- 

bi-directional trunk system in use in the U.S. West trial. As tion is the that the navigator make such interpretations 

shown in FIG. 3B, the trunk system is divided into a without any more user input than that required by the user 

uni-directional, analog "A" cable and a bi-directional, digital in selecting programming. Such suggestions by the naviga- 

"B" cable. As shown in FIG. 3C, each cable includes a 65 tor may be automated so that the navigator provides sug- 

number of 6 mhz channels which transport the data utilized gestions each time the system is activated, or the suggestions 

in the system of the present invention. may be provided by a specific user request. 
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The navigator may be implemented in a manner currently 
similar to conventional "agency" software. For example, 
certain types of searching tools currently available for the 
internet utilize a vector analysis technique wherein a vector 
map is calculated for each item which a particular user 5 
selects as part of a search. Thereafter, when a search for 
similar items is desired, the software calculates a vector map 
of the search items and compares this map with the map 
representing the average of the user's past selected prefer- 
ences. Only those search items which fall within a certain 10 
limited variance from the user preference map are then 
presented to the user. Applying this technique to the present 
invention, the service navigator would read and calculate a 
vector map for each of the selected items which a user views 
over a given period of time. Thereafter, each time the 15 
selection guide is loaded into the "smart" terminal, the 
navigator can perform an automatic or user-prompted search 
for similar items, and provide those items to the user. 

Yet another aspect of the interface and navigator is to 
provide interactive programming accessibility through an 20 
electronic program guide. The electronic program guide can 
be made to show the interactive services, such as home 
shopping and video on demand, as regular broadcast chan- 
nels in the television line-up, and thus a coherent paradigm 
is maintained for all services. 25 

An example of how each of the objects shown in FIG. 4 
would be used is as follows. 

In the television window, the normal broadcast channels 
may be scanned in a conventional manner by using channel- 3Q 
up and channel-down buttons on a conventional or custom- 
ized remote control. An advantage of the transmission 
system of the present invention is that information regarding 
the station, the length of the program, and the title of the 
program, can be overlaid on the television broadcast picture 35 
using media objects supplying such information which are 
provided in the data stream. 

The overlay can also display tie-ins to other interactive 
services in the program. 

The navigation field can display media objects such as a 40 
rotating globe (or any other visual representation), having 
different categories shown thereon which represent the dif- 
ferent programming areas available from the service pro- 
viders. In one example, the globe could rotate to show 
different menu items, and posters of each of the particular 45 
broadcast or service choices. In this example, the broadcast 
and service choices could be video objects of the actual 
images being broadcast at that time on the system. A preview 
clip of movies and shows can also be shown by directing a 
pointing mechanism and clicking on the appropriate 50 
indicator, and further information regarding each of the 
services is thereafter provided to the viewer on demand by 
downloading one or more additional media objects from the 
data stream. A similar interface can be provided for the video 
on demand menus. Posters can be shown for the different 55 
titles, a preview clip can be requested, and an interactive 
"buy" button tie-in used to allow the user to purchase a 
particular video. 

The program guide interface can display programs in the 
current time period, and other time periods, again using a 60 
globe or other suitable graphical representation for an inter- 
face. The TV guide offers an alternative to scanning chan- 
nels to find a particular program. Scanning can be incorpo- 
rated into the guide and customized to implement scanning 
by time period, or by other additional information available 65 
for each program (or service), such as length of running time 
and/or program stars. 
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A second aspect of the invention, the broadcast streaming 
approach provision of data to the end-user, will now be 
described with reference to FIGS. 5-8. 

The broadcast data stream contains all information that 
the end-user terminal needs to provide basic services for 
interactive video delivery service. Such basic services could 
include the electronic program guide (including up-to-date 
programming information for all available video program- 
ming from the head-end); a service navigation system (the 
"media valet"); and the user interface overview, to provide 
consistent look and feel across each of the various available 
services. It should be noted that not all of the information in 
the broadcast data stream will be required by the end-user 
terminal at any given time. Indeed, the repetition of the 
broadcast data stream allows the end-user terminal to select 
whatever information is needed at a given time. The end- 
user terminal contains means to decode and decompress the 
signal, and provide the sigaal to the user interface. An 
end-user terminal suitable for use with the information 
delivery system of the present invention is disclosed in 
co-pending U.S. patent application Ser. No. 7/970,308 
entitled Audio/Video computer architecture, and commer- 
cially available as the "REAL 3DO Multi-player System" 
developed by The 3DO Company and manufactured by 
Matsushita. 

The aforementioned end-user terminal includes a cache 
memo ry (see FIG. 7) to which components of the broadc ast 
data~stream may oe downloaded, ine structure or tne aala 
broadcast stream is well defined to allow the end-user 
terminal to cache information as required and remove infor- 
mation from the cache in a seamless manner. Information is 
t hen retrieved from the end-user terminal's memory cach e, 
or the broadcast stream, before any request is made to Ihe 
hcat^end server on the backchannel. By using a sophisti- 
cated end-user terminal, such as the 3DO Multiplayer, in 
conjunction with the broadcast stream, the viewer can 
manipulate basic services, such as scrolling through pro- 
gram guide, to determine what programming from the 
head-end server the individual subscriber desires to view at 
any given time. The server is therefore not required to 
continually respond to requests from a number of different 
subscribers at any given time to conduct repetitive, high- 
overhead, non-revenue generating activity. The broadcast 
data stream contains all the necessary information to allow 
the viewer to utilize the basic services without placing any 
overhead, other than that required to generate and maintain 
the broadcast stream, on the server. 

In a further aspect of the invention, the broadcast data 
stream may also include boot code for the end-user terminal. 
Where the boot code is included in the broadcast data 
stream, connection storms can be eliminated in the situation 
which, for example, occurs after resumption of service after 
a power outage where a number of users will simultaneously 
request services at the same time. Upon re-initiation of the 
broadcast data stream, the boot code is provided as a 
component of the stream to the end-user terminals, and there 
is thus no requirement for immediate backchannel commu- 
nication from each user on the system to the head-end server. 

General technical assumptions for various particular 
media objects are shown in FIG. 5. Each assumption defines 
the average size and bit requirement for each particular 
object. As shown in FIG. 5, seven types of media objects are 
contemplated: object code (for the boot code), text, music, 
still photos, animation, fonts, and short video. Thus, all of 
the object data could be repeated within the stream with a 
less than one second period of latency. 

FIG. 6 represents the media objects which are required for 
the user interface and which must be provided to the 
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end-user terminal. The data stream contains media objects terminal 100 will tune-in to a pre-selected, default frequency 

for each portion user interface that makes up a set of services of the broadcast data stream. The particular frequency can be 

which, in a given embodiment, may be considered basic embedded in the boot code, or can be provided in a separate 

interactive services. As shown in FIG. 6, these basic service function call to a "Level 2" server which is providing the 

interfaces should comprise: a Help And Tours interface; a 5 broadcast data stream. Alternatively, the control channel 

Video On Demand interface; a Pay-Per-View (PPV) Events with the broadcast data stream could be used to request a 

interface; the Electronic Program Guide (EPG^ interface; a continuous feed session from the communications manager, 

User Preferences interface; a Check Reservations interface; and the digital frequency for the broadcast data stream 

and an Advertising interface. In alternative embodiments, an would be returned during the session initiation. This allows 

"expanded" set of services would include additional inter- 10 the location of the broadcast data stream to be moved 

face objects, such as a Bulletin Board interface; a Guest dynamically or requested on demand. 

Services interface; a Games interface; an Education inter- The system reserved program reference number PRG C is 

face; and a Reference Materials interface. then read to obtain the directory of the program information 

FIG. 6 shows the number of media objects required for descriptor (PID) packs that describe the location, within the 

interfaces to basic services and for additional services, and 15 broadcast data stream, of the different user interfaces defined 

the_amountxlstorage_required ^by_all_media_objects._ Asian by the service providers. The PID packs may follow the 

exampieTTcons^ hardware standard set forth by the hardware provider 

object~defined in FIG. ~6. The electronic" pro gram~guide (Scientific Atlanta hardware in the U.S. West embodiment), 

requires one code module, one background photo, one piece and may be designed to follow any particular hardware of 

of animation, one thousand text objects, one background 20 the particular communications network in use. The system 

music object, and one specialized font object for the EPG reserved program reference number PRG C is then stored in 

interface. It should be noted that objects for the additional the user terminal's internal memory, 

services could be provided on the same broadcast stream as Changes to the user interface are supported by dynami- 

data stream, or may be provided on a separate, alternative 6 cally changing the PIDs for an interface during transmission 

mhz channel. These interfaces are included in FIG. 6 to 25 of the broadcast data stream. These changes should occur 

demonstrate the feasibility of using a broadcast stream with after user terminal 100 has stored PRG C . Thus, during idle 

a 6 mhz channel including those interfaces for both the basic periods, user terminal 100 re-reads PRG C to obtain any 

services and additional services. changes in the PID mapping. Alternatively, a well-known 

FIG. 7 is a depiction of the interaction of the MPEG mapping scheme between a particular PRG M and the user 

transport layer, the end-user terminal 100 and a network 30 interface could be used, therefore not requiring PRG C to be 

interface 110 in the end-user terminal. The user terminal 100 read during each idle period. This alternative approach 

includes the network interface 110, data cache 120 and a sacrifices making dynamic changes to the PIDs. 

communications manager 130, In operation, the output of The user interface can also include transition effects, 

the head-end for the broadcast stream would use the which allow seamless transition between different user 

MPEG-2 transport layer to transmit the media objects to the 35 menus and interfaces. A media object for the transition 

end-user terminals 100. The network interface module 110 effects, PRM^, is located within PRG C and a request is made 

within the user terminal 100 is used to parse the broadcast to network interface 110 to load the PID pack. The transition 

data stream for desired information. Media object calls are effects are stored in user terminal 100 in anticipation that the 

utilized to request information which is read by the network viewer will require use of these effects first, 

interface 100 and deposited into memory hardware 120 40 A media object for the electronic p rogram pride, PRM„_, 

within the user terminal. is floated within PRU C , and a request is made to the network 

The MPEG-2 transport layer uses the model of sending interface to load the PID pack. Within 2.3 seconds, the 

programs or program information description ("PID") average latency time as noted above, the EPG interface is 

packs. In this model, programs are treated as related groups 4S loaded into the user terminal 100 and may be presented to 

of elementary streams. In the U.S. West test, transport layer the viewer. When the viewer requests either the EPG or the 

hardware (manufactured by Scientific Atlanta) supports four necessary information will already be loaded into user 

elementary streams per program. These streams are desig- terminal 100 for provision to the user, 

nated for video, audio, and two private data channels, as Note that user terminal 100 may utilize the transition 

illustrated in FIG. 7. Each elementary stream is assigned a 5Q effects between screens during the latency period. In 

program information descriptor (PID). Each PID is refer- essence, the viewer sees a seamless interface transmission, 

enced by a number PID„. PID 0 is reserved and contains a an d to the viewer it appears that the system is interacting 

directory of all programs. Each program is referenced by a with the host to obtain the information requested by the 

number PRG„ and a two-stage mapping through PID 0 and viewer. Thus, the latency period is less noticeable to the 

the program map PID is done to obtain the information 55 viewer as the particular transition effects provide video, 

contained within the program. audio, or other information to occupy the viewer during the 

The program reference number PRG 0 contains a directory latency period, 

used to map the naming convention used to request a specific A session with the broadcast data stream will remain 

interface to a particular PRG„. The format of the data in the active until the digital tuner is required for other purposes, 

PRG C is completely independent from formats used by the 60 An example of the response of the system to a particular 

MPEG transport layer or PID 0 . user request using the example of a user request to a main 

When the user terminal 100 is brought on-line, such as at menu screen is as follows. When a viewer wants the main 

power up or by a specific selection by the user, the boot code services menu, a media object PRM main menu is located 

contained in the data stream is provided to the user terminal. within PRG C . The digital tuner, if tuned to an alternative 

The end-user terminal 100 will interpret the boot code, and 65 digital frequency as discussed above, can be retuned to the 

initiate a boot process to start the terminal. Once the booting data stream. A request is made to the network interface in the 

process is completed, a digital tuner (not shown) in the user end-user terminal to load the main menu PID pack. A 
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graphic or animation object is then used as a transition to the rated as part of the present invention and utilized with the 

new interface, thus masking the latency and the potential broadcast streaming approach, other types of interface 

re-tuning to the broadcast data stream. Within an average of screens, which do not use iconic representations of media 

2.3 seconds, the interface is ready to be presented to the objects, may be utilized within the context of the present 

viewer. The previous EPG data is held in memory cache 120 5 invention. The system includes the capability to incorporate 

in user terminal 100 as long as possible before being real ^me images as part of the viewing experience. For 

expunged from memory. Alternatively, the information for example, service providers whose main business consists of 

the main menu could have been located in memory cache reta ^ cloth ^ s ^ cs ma ? ™ h to . ^7 S oods avail f le for 

120 if it had previously been used, thus avoiding the data ^ P urchasc , m a representation which presents the user 
stream access 10 411 exam P^ e °* now sucn g° oa s would appear in a real 

, , . JJiL world situation. A clothing manufacturer may wish to show 

Should the viewer want video on demand data, the offa newcoUectionb y ( for example, showing a scene where 

operation would be similar as that described to the main ^ clothes m WQm b ^viduals at a social function, such 

menu function. Tte media object for toe video on demand M a allowi ^ yiewer tQ ^ how ^ 

?RM vod , is located wimm PRO The digital tuner, if clothes in one eDvironment in which me clothes 

necessary, would be re-tuned to the broadcast data stream, is fee used , f ^ ^ wanled information on , 

and a request made to ^network interface to load the video ^ f ^ ^ ^ ^ a gmot (usJ for 

on demand PID pack. When a selection * made by the user , a remote tQ Qn ^ dcuUr ^ 

based on the mformatton provided in the PID pack, he of interest aQd additioQa] infomilion abolIt the item could 

digital tuner can tune to an alternative channel where the , . • i . ™ f . , r 4U 

^ , .„ „ rt be displayed. The foregoing example is merely one of the 

video on demand will occur. 20 . c ■ * *• • j • i~* 

many types of interactive means a service provider might 

Such media objects for VOD can include PRM V ^ posters, utilize ^ me mler face of the present invention. Since the 

which can include a set of posters representing the different media ob j ects may be man j pu iated by the service providers, 

movies available on video on demand. The media object can ^ appearance of the interface may be customized for 

also include PRHw^,^ which can include a short video individual service providers on a desired basis, 
clip of the movie which is available in the video on demand 25 example of ^ contcmplatcd uses of me interfacc 

service. m con j unc tion with the broadcast streaming approach 

Bandwidth management and selection of media objects include the provision of a "barker" mode in which adver- 

from the MPEG-2 data stream are handled by calls to tising objects can be inserted into the stream and displayed 

network interface 110. The throughput from the network 3q to me USQt without user interaction. (A "barker" is a person 

interface should be sufficient to handle the data rate for the wno advertises by hawking at the entrance to a show.) In this 

PID packs for the user interfaces. Likewise, the data require- case> me barker mode could be active and utilized with 

ment from the PID packs from the interfaces should not e i mer tne user interface discussed with respect to FIG. 4 or 

exceed the range of the network interface. (Both criteria are fog real-world interface example set forth above. In either 

met using the aforementioned 3DO Multiplayer as the ^ case> the advertisement can be output to the viewing screen 

end-user terminal.) as a tease to the viewer regarding a particular product or 

The potential does exist for data to be missed by the service, 
end-user terminal In such cases, because there is no com- The barker mode can be tied into the smart service 
munication from the end-usei terminal to the head-end navigator. For example, the service navigator can record the 
server, the end-user terminal must delay for the worst case ^ types of products and services which the viewer purchases 
latency period until the missing data appears in the data through on-line services, and/or the advertisements or prod- 
stream. uc ts which the viewer may select, over a period of time, to 

The service system models set forth above give rise to a view more information on. This file may be sold by the cable 

number of variations which are considered to be within the provider to service providers, or may be user controlled, so 

scope of the invention. 45 that the user has the opportunity to sell access to the viewer's 

In some embodiments, interactive services which will own preferences to the transmission provider or the service 

utilize even greater degrees of backchannel communication providers. The barker mode could also be viewer controlled 

to the host head-end, can also be included. Nevertheless, to prohibit such advertisements from appearing on the 

even in embodiments where significant backchannel is viewer's individualized user interface. The information 

required to provide information to the head-end, one or more 50 gathered by the service navigator could also be utilized by 

alternative streams can be provided by the head-end server the service providers to provide viewer or group specific 

to include such information as, for example, the Sears, programming. 

Roebuck & Company catalog. Again, such a broadcast Still further variations of the system of the present inven- 

channel would operate under the same principles set forth tion exist with respect to the smart service navigator. For 

herein, wherein all the information which is required by the 55 example, the service navigator itself need not be limited to 

user to browse through the particular selections can be a service navigator which is provided by any one source, 

provided continuously on a repeating data stream. The user such as the transmission provider. Second source providers 

terminal will then extract from the data stream based on the could develop customized, field optimized navigators for 

interfaces supplied by the service provider, in this case particular fields of interest, such as movies, commerce, or 

Sears, Roebuck & Company. In such instances, again, the eo television. 

backchannel is reduced to mat required for ordering specific In addition, in a further variation on the information 
components from the service provider. In the Sears, Roe- gathering concept set forth above with respect to the corn- 
buck example, the only overhead which is required by the mercial service providers, the navigator may gather general 
service provider is the provision of the transmission band- information feedback on viewer habits, and such informa- 
width and the overhead at the server. 55 tion can be used by the service providers to optimize system 
While the interface shown in FIG. 4 represents one broadcast performance. For example, if the service providers 
example of a user interface screen which may be incorpo- know that viewer demand for a particular program is great- 
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est during a particular period, the provider can adjust pro- a selection, and only at that time does the viewer make use 

gram scheduling accordingly. This information could also be of the backchannel to the head-end. Note that the function 

used to assess the number of viewers utilizing a particular selected can be provided on a separate, 6 mhz broadcast 

service, and the frequency of such use, when determining channel, and that the user interface can include the necessary 

revenue issues between the transmission provider and the 5 instructions to have the user terminal re-tune to a different 

service provider. Thus, the system of the present invention broadcast channel to access the service. Alternatively, addi- 

provides a mechanism wherein the broadcast system can be donal broadcast data streams can be provided on other 

optimize information transmission by compensating for broadcast channels with objects for specific services on that 

heavy load demands on the head end of the system. channel > thc ™f mt f rface and /f rimnal can decodin g 

n :„ , . . , „ , . . A _ in a manner that is transparent to the viewer. 

Still another variation on the use of the service navigator 1( J . n , . 

. ... x- . iL In still another embodiment of the invention, the system 

includes allowing the navigator to continue operating in the , ... . « , , . . , ' . 

. , , ' % r . j . . » can be utilized with low bandwidth transmission systems. A 

background, while the viewer is engaged in viewing a . , . , , . 4 , - 

^V, 1 . , ' b . , A . . . storage medium can be provided at the user-end of the 

currently running program, or while the viewer s television ^ & «. r K. , . .« . , , 

«• , ■, • • r . L t . T ... system, and information which might otherwise be provided 

is off, while the viewer is away from ttw home etc. In .this £ ^ k ^ * d oQ ^ 

mode, the smart navigator may be acting on behalf of the 15 , , J „ - t . .« . T ... 

' . . & j . t . „ 4l _ accessed by calls from objects in the stream. In this 

user, selecting, sorting and queuing information for the . 4 . t / -j j • *u * 

. J , & ' ° \ & A M1 , .... variation, the amount of information provided in the stream 

viewer when the viewer returns. As will be readily ' . - . - .. • -, j 

j .j . . , c _ . t j u versus the amount of information provided on the storage 

understood, this mode of the smart navigator could be , A . r . v „• 

combined with a "barker" mode wherein when the viewer caD v «* d6 P'»dmg on the particular application. 

. t , ,. 4 t , on The storage medium could comprise, for example, a com- 

returr^toviewthesystem^hoseprogramsofinterestcanbe 20 gg g ^ ^ Qf a ^ ? a pracdc / ex amp g , a 

relayed to tne viewer. catalog distributer ol retail items may desire to provide a 

Other variations of the various examples set forth herein sep arate broadcast data stream, but the amount of informa- 

are contemplated for use with the present invention, and are tion necessary to input into the stream may be prohibitive, 

considered to be within the scope of the invention. ^ Iq such a casc> ihf . distributor could store on a CD ROM a 

It should be noted that the particular user terminal which number of the media objects normally input into the stream, 

is required for use in the system is also independent of the SU ch as particular items of clothing which the distributor will 

system architecture. While the architecture described herein carry for a long period of time, or other presentation objects 

has been set forth with respect to the interactive game suc h as backgrounds, music, and animation, which the 

system produced by The 3DO Company, the system would 3Q distributor will use on a repeated basis to present items to the 

work equally as well with hardware from various vendors, viewer/consumer. The information on the CD ROM can be 

and personal computers such as the Macintosh and updated periodically, by distributing additional disks, but the 

PC-compatible computers. With each different embodiment information on how the stored data is to be manipulated can 

of hardware, different data types would comprise the differ- be dynamically updated almost instantly from the data 

ent media objects, each data type being specific to the 35 stream. The data stream can also include price information, 

particular platform. special sale information, and "barker" instructions. In this 

FIG. 8 shows the size requirements, overall bandwidth embodiment, significantly less bandwidth is required to 

requirements, and transmission times, for each user provide the user with a great deal of information, 

interface, and the worst case latency (equal to the total A further aspect of the present invention is the manner in 

period for repetition of the data stream) for the system as a ^ which the information provided via the broadcast data 

whole. As shown therein, the total required bandwidth (basic stream is manipulated by the end-user terminal in the 

and additional services) is 93.2 megabits, or 3.84 seconds. system. FIG. 9 is a representation of a novel method of 

Thus, 3.84 seconds defines the worst case latency for the encoding information for use with the end-user terminal in 

system, with the average access time required to obtain a the system of the present invention, 

particular piece of information being 1.92 seconds. The 45 Certain end-user terminals suitable for use with the 

interfaces beyond those of the basic services account for present invention will have a limited memory capacity. In 

37.0 megabits of data or 1.5 seconds latency. sucn ca ses, some form of compression or encoding of the 

Thus, for a stream that supports only the base services, data to be stored in the memory is desirable, however such 

and given the 27 Mbps bandwidth of the U.S. West compression or encoding should not adversely affect the 

environment, the bit requirement on such a system would be 50 response time of the system. 

56.2 Mb, or a worst case latency of 2.3 seconds. This means As noted above, one feature of the system is to provide 

that an average access time to information would be half of superior navigation to television viewers. In accordance 

2.3 seconds, or 1.15 seconds. with this object, superior use of the information database 

In the embodiment set forth above where the end-user provided by the service providers may be made in the system 

terminal 100 contains a cache memory 120, information 55 by providing additional information infused with the infor- 

could be cached in the end-user terminal for one or more mation from the service providers. In one aspect, each 

previously -used interfaces to provide rapid access without service provider's database can be extended with additional 

using the broadcast stream. It should be noted that the fields and information licensed from other providers, which 

system of the present invention may be utilized in combi- , menxan-be ^integrated with the information provided from 

nation with any amount of backchannel communication 60 uie.seiyice^royMer^Sjuctiuu^nnation can include demo- 

from the user terminal, for example, for use in selecting graphic info lmation^ ratings, etc. Further, through the use of 

different services such as pay-per-view, home shopping, and encoding techniques and delivery protocols, the end-user 

interactive games. However, the data stream includes all terminal can be instructed to store user databases and 

necessary media objects which are required by the sub- memory and perform efficient searches without access to the 

scriber to obtain information about the various services 65 server or via a backchannel communication scheme. Infor- 

a vail able from the service provider. Once the viewer decides mation captured from viewers while using the information 

upon a particular service or program, the viewer can make system is used to provide assistance to the viewer in the 
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future. As Doted above, the "media valet" can provide information, with detailed information appearing later 

choices to the viewer that are tailored to past interests and depending on the response time of the gateway, 

habits. Another alternative is to use a smaller data set. A window 

In accordance with these objects, it is extremely desirable of time can be chosen in which sublets of the entire 

to store the EPG and other databases in the user terminal for 5 electronic program guide (i.e., a daily electronic program 

use on an "as-needed" basis. This guarantees predictable and guide or an hourly electronic program guide) are saved to 

rapid response to requests made by the viewer in the memory. This would give the user full jn fprmjLtiaa imme - 

situations where the viewer is watching television and d iately for the current time window, but sacrifice the viewin g 

requests information, the viewer scrolling through the EPG, an dpotential recording of future programming without lirst 

or the viewer is browsing through pay-per-view and video 10 accessing the server or communication Channel, 

on demand listings. Still another alternative is to use a single communication 

In storing the essential databases for use with the system channel to query a server resident database. This places all 

of the present invention, the electronic program guide, the the database information on the server and frees memory 

video on demand database, and the pay-per-view database, space in the end -user terminal. However, the network must 

a^understanding ofJ]^storage_demands_of su^^da^abases_ 15 now handle more traffic for browsing activity done by the 

is requiredr — ~ """ — ^ viewer. It also requires a response from a Level 2 gateway 

<:::::: ^s~an-example of the encoding scheme of the present that is timely and consistent to provide rapid response to 

invention, the electronic program guide database specifica- viewer requests. 

tion and requirements are hereinafter described. Still another alternative is to store a compressed version 

The amount of data used to represent seven days of °f tne electronic program guide in the end-user terminal, 

electronic program guide listings is approximately 1.70 Using LZW compression (a common compression 

megabytes depending upon the programming appearing technique) on the electronic program guide, the data size of 

during the week. These are the storage requirements for data the electronic program guide can be reduced from 1.7 

supplied by the Tribune Media Company for programming ^ megabytes to 509 kilobytes. At these data sizes, a conven- 

in the San Francisco Bay Area. tional end-user terminal suitable for use with the system of 

The electronic program guide and video on demand data ^ P resent invention could store the data, but neither of the 

includes the following information: start time; duration; techniques allows selective decoding to access only a por- 

title; channel; description; subtitle; part sequence; actors and don of me ^formation. The entire electronic program guide 

directors; genre; year; rating; warning; category; short 30 would have to be decompressed before the data could be 

movie description; and long movie description. The speci- accessed. This decompression time would add to the overall 

flcation of 1.70 megabytes of data is a specification for raw svstem ktencv ^ would rcc L mre me terminal to 

text with embedded tags to designate different data fields. store the decompressed data. 

Indexing and searching structure is not included in the text Finally, the electronic program guide information can be 
size. 1.7 megabytes of text is approximately equal to 8,761 35 encoded into a data structure that uses a dictionary format 
program listings at 193 bytes per listing. An index for the and which relies on the redundancy of TV. data to reduce its 
electronic program guide is larger than the electronic pro- overall size. This would remove the redundant use of words 
gram guide itself, occupying 1.96 megabytes. This full text and phrases from the electronic program guide to achieve 
index is used to search arbitrarily for words in the electronic storage savings. The dictionary format could provide suffi- 
program guide. This also assumes 48 cable channels: com- ^ cient savings to store the electronic program guide and a 
prised of 21 network channels and 27 cable channels. The searching structure within a limited storage capacity avail- 
cable channels, while having more bytes per listing than able on such conventional end-user terminals. Ideally, the 
network channels, have fewer listings due to generally savings achieved by encoding this information would rival 
longer program times. As a result, the total memory require- the savings achieved by the LZW compression, 
ment to store searchable, weekly electric program guide is 45 However, unlike the compressed formats, the encoded 
3.7 megabytes. format can be used directly to create text displays and 

Because this may be beyond the memory capacity of perform searches, 

many of the user terminals suitable for use with the system An encoding scheme in accordance with the present 

of the present invention, an encoding scheme may be invention is shown in FIG. 9. The program listing contains 

utilized to reduce the storage requirement for the electronic 50 an array of offsets to the dictionary of terms utilized to build 

program guide data set. the EPG. A listing vector contains offsets to the program 

Several alternatives for th is encoding scheme exist. Th e listing structure for each program listing. The offsets are 4 

first alternative is to reduce the amount 01 information used bytes that allow 4 gigabytes of data to be referenced. The 

in the electronic program guide. For example, the minimal vector has a maximum of 65,535 entries that can be refer- 

electronic program guide could comprise data for the start 55 enced by using 2-byte offsets into that vector. A sort vector 

time, duration, title, and channel. This reduces the memory contains sorted 2-byte offsets to the listing vector. There may 

requirement, but sacrifices most of the descriptive informa- be many sort vectors constructed from fields in each pro- 

tion and would limit the amount and quality of the infor- gram listing, for example, by sorting by title, sorting by 

mation provided to the viewer in the media valet. A second channel and time, etc. A binary search (a common searching 

alternative is to create an algorithm that stores the reduced 60 technique) can be used to locate the particular program 

data set from the first alternative in the user terminal and fisting through the appropriate sort vector. The sort vector 

simultaneously generates a request to the Level 2 service shares with the fisting vector the same maximum of 65,535 

provider's gateway for more detailed information. This entries that allows all listing vector entries to be referenced, 

provides a limited yet rapid response to the viewer's request As shown, the Program Listing structure is comprised of 

with the gateway providing the detailed information. This 65 a listing/header and Run Length encoded fields. Some 

creates a multi-mode situation in the interface, where the electronic program guide information that is common to all 

user would have an immediate response with limited listings will be quantized into the listing header. All other 
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information appearing in the program listing will be repre- data compression is used on the encoded format to reduce 

seated by a field I.D., a length, and a series of 2-byte offsets the electronic program guide bandwidth requirement, the 

to the dictionary vector. To locate a particular field I.D., the format for the encoding could produce redundancies that the 

listing headers would be traversed until the field I.D. is delivery impression algorithm could locate. This would 

located. 5 produce better compression and result in additional time 

Finally, a dictionary is shown which contains all the savings during delivery, 
words found in the electronic program guide. Frequent The video on demand and pay-per-view databases could 
phrases are also encoded into the dictionary to take advan- be encoded using the same technique for similar storage 
tage of the redundant use of program titles and descriptions. savings. A sample from the video on demand data covering 
The case of the words is maintained in the dictionary, and 10 titles beginning with the letters "e" and "f * is used as an 
punctuation is also entered with the words. This allows the example. This would represent 2,837 listings or 1 .3 mega- 
dictionary to faithfully recreate a line of text with proper bytes of data at 442 bytes per listing. The proposed encoded 
case and punctuation. However, original word spacing is not format set forth above with respect to the electronic program 
maintained. The dictionary is made up of two structures. The guide reduces the storage requirement by 54% to 461 
dictionary word table contains all the words, while the 1 5 kilobytes at 162 bytes per listing. Extrapolating from the 
dictionary vector contains 4-byte offsets to the dictionary listings for the letters "e" and "f to the full alphabet results 
word table. This implies a maximum of 65,535 entries in the in approximately 44,000 listings or about 7.2 megabytes of 
dictionary, and 4 gigabytes of dictionary data. Sort vectors data. This memory estimate includes a single search index 
can also be associated with the dictionary vector. (These which could be assigned to any field comprising the video on 
maximum values are purely representative of this particular 20 demand data set. Each additional search index would require 
example.) 88 kilobytes. 

Using the proposed technique to encode the aforemen- The intelligence of the user terminal could therefore 

tioned electronic program guide for the San Francisco Bay completely relieve the Level 2 server from the task of 

Area, seven days of data can be encoded to a data space of database searching for the electronic program guide and 

438 kilobytes including search indexes. Seven days of data 25 video on demand database. If the Level 2 gateway instead 

now also comprises 8,761 program listings occupying a total sent those databases entirely through the broadcast data 

space of 50 bytes per listing. The keyed search index stream, the end-user terminal could perform the searches 

necessary to create the electronic program guide display is with predictable response times. If the video on demand 

18 kilobytes. Each additional keyed index requires only 18 database were encoded into a separate data stream, the 

kilobytes. The index used to locate program listings where 30 delivery time for the video on demand information would be 

a given word appears would be an additional 289 kilobytes. 2.1 seconds (assuming a 7.2 megabyte database transmitted 

This would be equivalent to the full text index described at 27 Mbps). 

above at 1.96 megabytes. This index would answer such The user interface is designed to provide viewers with 

inquiries as searching for all movies by a particular actor, or optimum choice, but not to overload the user with a too 

all movies in a particular movie category type, such as 35 many choices which will drive the user to avoid using the 

comedies. The proposed encoded format is therefore a interface because they are overwhelmed. The interface is 

competitive one compared with the results achieved with the designed to leverage itself off what the viewing public 

LZW compression on the original EPG text. already experiences — integrating new experiences around 

Additional improvements of the proposed format can ^ viewers' existing experiences, 

achieve additional savings over the estimated 438 kilobytes. The user interface of the present invention uses the 

For example, were one to identify and remove additional predictable response times of he broadcast data stream to 

redundant information, such as short and long movie offer interactivity to the services offered by the information 

descriptions which are essentially the same, would reduce providers through a consistent look and feel, 

the storage requirement by approximately 4% to 421 kilo- 45 First, the interface is highly visual, as shown in FIG. 4. 

bytes at 48 bytes per listing. The interface items are depicted by representations of them- 

In addition, one could reduce the information used in the selves. For example, movies can be represented by poster 

electronic program guide. As set forth above, the minimal art, and services can be represented buy the service logo. As 

required electronic program guide information would be the such, the viewer can instantly comprehend the hierarchy and 

start time, duration, title, and channel. This would reduce the 50 array of items available. 

storage requirement by 64% to 156 kilobytes at 17 bytes per The interface incorporates graphics, music and transition 
listing. The time window concept described above as a effects which have a quality similar to or equal that of a 
stored alternative could also be used A daily window would television picture. By animating the visual display, the 
require approximately 22 kilobytes per day. To add back the display is never idle when waiting for viewer input, 
description of information, the mixture of EPG information 55 Furthermore, the interface provides a navigation platform 
would become start time, duration, title, channel, that may be utilized across different service providers. A 
description, short movie description and long movie descrip- standard paradigm provides a singular visual understanding 
tion. This reduces the storage requirement by about 22% to of the categories and hierarchy of items which are available. 
342 kilobytes at 39 bytes per listing. Using short movie In one embodiment, the paradigm comprises an organization 
descriptions instead achieves 26% savings to 325 kilobytes 60 wherein one moves vertically on the screen to choose 
at 37 bytes per listing. between higher level categories, while one moves horizon- 
In addition, one could restrict the text used to build the full tally to select within the category. As such, more than one 
text index. Only those fields deemed important (i.e. titles, menu can be displayed at a given time, and the viewer is less 
descriptions, actors) would be utilized. This would reduce likely to get caught in layer upon layer of menus, 
the additional 286 kilobytes required for this index. Finally, 65 Furthermore the interface is designed to be expandable, so 
the format used for encoding the electronic program guide that as more services become available and more program- 
can be matched with the algorithm used for compression. If ming is offered, they can be easily added to the interface. In 
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a further aspect, the interface can be provided in a unique, 
real-world representative mode. Through customization of 
various media objects, service providers can add or change 
the interface based on the provider's particular applications 
or needs. 5 

A unique aspect of the interface is the provision of a 
"smart" media "valet". Through the use of intelligent filter- 
ing and weighting algorithms, the interface can be person- 
alized for each viewer household. The valet can operate in 
a foreground or background mode, can gather information 10 
about the user for the benefit of the user and service 
providers, and increases the efficiency of the viewing expe- 
rience for the viewer. 

Yet another aspect of the interface is to provide interactive 
programming accessibility through the EPG. The EPG can 
be made to show the interactive services, such as home 
shopping and video on demand as regular channels in the 
television line-up, and thus a coherent paradigm is main- 
tained for all services. 

The various objects and advantages of the present inven- 
tion will be apparent to those skilled in the art. Numerous 20 
modifications to the system, and variations to the means for 
distributing data over a communication medium, will be 
obvious to those of average skill in the art. For example, the 
information system is independent of the particular commu- 
nications medium upon which it is used. Furthermore, the 25 
system is not limited to a single broadcast stream, but may 
include many different broadcast streams for transmitting 
data. Various methods of providing the media objects to the 
user, either entirely through the stream, or with a portion 
stored in the user's terminal, are contemplated. As an 30 
additional example, the system is not limited to the use of 
any particular end-user terminal, but may be utilized with 
any number of different end-user terminals. Such modifica- 
tions are intended to be within the scope of the invention as 
disclosed in the instant written description, the figures, and 35 
the following claims. 

What is claimed is: 

1. An information delivery system for delivery of audio, 
video, and user data through a communication medium from 

a head end to a user end, the user end including a display 40 
device, the communication medium having a plurality of 
transmission channels, said channels carrying a variety of 
broadcast programming information on ones of said plural- 
ity of transmission channels, comprising: 

a server node having means for broadcasting a data stream 45 
on a subset of said transmission channels, the data 
stream comprising a plurality of compressed data 
objects, each data object comprising at least one media 
object, each media object comprising a still image, a 
motion video image, an audio clip, or text in encoded 50 
form, the data objects further including broadcast pro- 
gramming content information and instruction code, 
directing the placement of the data and media objects 
on the display device to provide a broadcast program- 
ming information program guide, the data stream being 55 
substantially repeated at regular intervals in multi- 
plexed fashion over the communication medium; 
a client node coupled to the display device, the client node 
having means for receiving the data stream, for decom- 
pressing at least selected portions of the stream, and for 60 
producing a user-detectable output on the display 
device in response to the data stream. 

2. The information delivery system of claim 1 wherein the 
system includes backchannel communication, and the client 
node communicates with the server node via the backchan- 65 
nel communication to process information requests from a 
viewer. 
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3. The information delivery system of claim 1 wherein the 
means for broadcasting includes means for broadcasting a 
plurality of data steams in a multiplexed fashion; and the 
means for receiving including means for producing a user- 
detectable output in a user-selectable subset of the plurality 
of data streams. 

4. The information delivery system of claim 1 further 
including a user interface, a portion of the user interface 
being resident in the client node and a portion of the user 
interface being provided in at least one of the data objects. 

5. The information delivery system as defined in claim 1 
wherein the data stream is transmitted via the level two 
transport layer of the MPEG 2 transport standard. 

6. The information delivery system as defined in claim 1 
wherein a portion of the user interface is resident in the 
client note. 

7. An information delivery system for use with a com- 
munication medium having a plurality of transmission 
channels, said channels carrying a variety of broadcast 
programming content on ones of said plurality of transmis- 
sion channels from a head end to a user end, the user end 
including at least one display device, comprising: 

a server node having means for broadcasting a plurality of 
data streams on a subset of said transmission channels 
in multiplexed fashion over the communication 
medium, each data stream being comprised of a plu- 
rality of compressed data and media objects in encoded 
form, each media object comprising a still image, a 
motion video image, an audio clip, or text in encoded 
form, the data objects including broadcast program- 
ming content information and instruction code direct- 
ing the placement of the media objects on the display 
device to generate a user interface, including said 
content information, at least a majority of data stream 
being repeated at regular intervals, the data stream 
being formatted so that each object has a maximum 
latency; 

at least one distribution node; and 

a plurality of client nodes coupled to the transmission 
channels at the user end each having means for receiv- 
ing the data streams, for decompressing the streams, 
and for producing a user-detectable output in response 
to each data stream in a user-selectable subset of the 
plurality of data streams on at least one display device, 
and means for maintaining said user interface for said 
maximum latency. 

8. The information delivery system of claim 7 wherein the 
data stream further includes boot instructions to the client 
node. 

9. The information delivery system of claim 7 wherein 
said user interface comprises a program guide containing 
information on programming and services available on the 
information delivery system. 

10. The information delivery system of claim 9 wherein 
the broadcast programming content information is updated 
prior to broadcast in the data stream. 

11. The information delivery system as defined in claim 7 
further including back communication between the user 
interface and the server node. 

12. The information delivery system is defined in claim 7 
wherein a portion of the user interface is resident in each 
said client node. 

13. An information distribution system coupled to a 
transmission medium having a plurality of transmission 
channels, the transmission system carrying broadcast pro- 
gramming from a variety of broadcast sources to a user end, 
the user end including a display device, comprising: 
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a head end server broadcasting at least one compressed 
data stream on at least one of said transmission 
channels, the data stream including a plurality of media 
objects comprising a still image, a motion video image, 
an audio clip, text in encoded form or broadcast pro- 
gramming content information, and programming code 
directing the placement of the media object on the 
display device to generate a program guide, wherein 
the data stream is substantially repeated at regular 
intervals; and 

an end user terminal coupled to the head end server via 
said transmission medium and including means for 
receiving the data stream, means for displaying the 
objects on the display device, means for decompressing 
the data stream, and selectively interacting with the 
data stream to remove media objects and to display the 
media objects to the user display in response to user 
input. 

14. Trie information delivery system of claim 13 wherein 
the data stream is broadcast via the level 2 transport layer of 20 
the MPEG-2 transport standard. 

15. The information delivery system of claim 13 wherein 
the head end broadcasts a plurality of data streams, each data 
stream including a plurality of media objects and comprising 
a digital time multiplexed signal. 

16. The information distribution system of claim 13 
wherein the distribution system further includes: 

at least one repeater node coupled between the head end 

and the end user terminal; 
a client interface unit including 
means for decoding the data stream, and for producing 
a user detectible output in response to a user request 
to output a specific media object by decoding a 
subset of each of the data streams. 

17. An information delivery system coupled to a trans- 
mission medium having a plurality of transmission channels, 
the transmission system carrying broadcast programming 
content from at least a broadcast television interface and at 
least one information service provider to a user end, the user 
end including a display device, including: 

a head end broadcasting a data stream of compressed 
media objects comprising a still image, a motion video 
image, an audio clip, or text in encoded form, and 
programming code directing the placement of the 
media object on the display device, [in encoded form,] 
on at least one of said transmission channels, the head 
end including an encoding means for encoding infor- 
mation in the media objects into an encoded form; 

wherein 

the data stream further includes a programming guide 
built from said media objects and containing pro- 
gramming information of content of the broadcast 
programming or the information service provider; 
and 

the user terminal is coupled to the head-end and receiv- 
ing the media objects, the user terminal having an 
output and including decompression means and 
decoding means for decoding information in the 
media objects; and 
a user interface, at least partially stored in the user- 
terminal, the user interface including means for select- 
ing a user-defined subset of media objects for provision 
to the output of the user terminal. 
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18. An information navigation system for an information 
delivery system, the information delivery system including 
a head end and a user end coupled by a transmission medium 
having a plurality of channels, the head end including a 
source of audio/visual programming transmitted on a first 
subset of said plurality of channels, comprising: 

an electronic program guide, the electronic program guide 
comprising a content listing of the audio/visual pro- 
gramming available on the information delivery sys- 
tem; 

a user interface, at least partially provided in the user end; 
and 

a service navigator, the user interface interacting with the 
service navigator and the electronic program guide, 

wherein the electronic program guide and user interface 
are transmitted to the user end in a data stream on a 
second subset of said plurality of channels, the data 
stream being comprised of a substantially repeating 
compressed stream of data objects including said con- 
tent listing, motion video, audio, text and programming 
code directing the assembly of the user interface, and is 
responsive to user input. 

19. An information delivery system for use with a com- 
munications network including a plurality of channels which 
provide broadcast program information, comprising: 

a server providing a data stream comprising a plurality of 
compressed data objects, each data object comprising 
at least a plurality of media objects, each media object 
comprising a still image, a motion video image, an 
audio clip, or text in compressed form, and including at 
least one data object comprising programming content 
information, the data stream being repeated at regular 
intervals in multiplexed fashion over the communica- 
tions network; 

a user terminal and display device, coupled to the server 
via the communications network; 

a programming guide containing information on services 
available on the information delivery system, the pro- 
gramming guide being built from said data objects 
provided in the data stream; 

a user interface, at least a portion of which is provided in 
and built by the user terminal from the data objects in 
the data stream; 

a service navigation system, interacting with the user 
interface and the programming guide, to record user 
preferences; and 

an interactive mechanism coupled to the user terminal for 
accessing, the programming guide, and user interface. 

20. The user interface of claim 19 further including a 
broadcast television interface. 

21. The user interface of claim 19 wherein the service 
navigation system further includes a user customizable 
selection guide which records user selections over a period 
of time and displays the selections when prompted by the 
user. 

22. The user interface of claim 19 wherein the media 
objects are provided to the interface to change interactive 
components on the interface. 
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